Papers with full-vocabulary counterpart
Accelerated Reinforcement Learning for Sentence Generation by Vocabulary Prediction (N19-1)
Copied to clipboard
| Challenge: | In reinforcement learning-based sentence generation, the large action space is often too computa-tionally demanding to be used with large training data. |
| Approach: | They propose to reduce the action space by using dynamic vocabulary prediction to generate a fixed-size small vocabulary for each input to generate its target sentence. |
| Outcome: | The proposed method achieves faster reinforcement learning (2.7x faster) with less GPU memory (2.3x less) and more rewards with fewer iterations of supervised pre-training. |